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Abstract 

The unknown inputs in a dynamical system may represent unknown external drivers, input uncer¬ 
tainty, state uncertainty, or instrument faults and thus unknown-input reconstruction has several wide¬ 
spread applications. In this paper we consider delayed recursive reconstruction of states and unknown 
inputs for both square and non-square systems. That is, we develop filters that use current measurements 
to estimate past states and reconstruct past inputs. We further derive necessary and sufficient conditions 
for convergence of filter estimates and show that these convergence properties are related to multivariable 
zeros of the system. With the help of illustrative examples we highlight the key contributions of this 
paper in relation with the existing literature. Finally, we also show that existing unbiased minimum- 
variance filters are special cases of the proposed filters and as a consequence the convergence results 
in this paper also apply to existing unbiased minimum-variance filters. 


1. Introduction 

Unknown inputs in a dynamical system may represent unknown external drivers, input uncer¬ 
tainty, state uncertainty, or instrument faults. Thus both reconstruction of unknown-inputs and 
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estimation of states in the presenee of unknown inputs, have numerous applieations in all fields 
of engineering. These are fundamental problems that have been of interest for the last several 
deeades with a range of papers relating to state estimation and unknown-input reeonstruetionlfTl, 

iia, m, a, m, a, m, a, a, m, cd, ei, ei, ei, a, ei, m, eh. wwie, bo* 

diserete-time and eontinuous-time versions of the problem reeeived attention, in the diserete-time 
setting, the problem ean be stated in its simplest form as the problem of estimating the state Xk 
and/or the unknown inputs for linear systems of the form 

Xk+i = Axk +Hek, ( 1 . 1 ) 

yk = Cxk, ( 1 . 2 ) 


using knowledge of the model equations and measurements of the outputs yk alone. 

The early works in this area El, 0 approaehed this as a system inversion problem and 
foeussed on observability eonditions under whieh estimation of unknown inputs are possible. 
Subsequently, a number of papers over the next several years foeussed on eonstruetion of 
observers for state estimation in the presenee of unknown inputs [01, [[51, [[61, 0, IH, 0, 
m, ED, El, El with varying approaehes. 

More reeently, interest has turned to reeonstrueting the unknown inputs in addition to es¬ 
timation of the states El . ESl . [[T9l . [[T6l . Il20l . |[2T1 . [[2l . |[23l . Some work like S, Il23l 
suggest that input reeonstruetion ean be eoneeived as an added step after unbiased estimates of 
the states of the systems are obtained. However, both the state estimation literature and input 
reeonstruetion literature foeussed on estimating the states or inputs at the immediate previous 
time step given output measurements until the eurrent time step. Sueh an approaeh invariably led 
to an assumption that CH has full eolumn rank or a elosely related assumption. This assumption 
ensured that all the unknown inputs at time step k — 1 direetly affeeted the outputs at time step 
k (as is obvious from a simple substitution in ( [1.1[ ) and (1.2)), and therefore was a neeessary 
eondition for being able to estimate Xk and/or Ck-i from yk- This beeomes a fairly restrietive 
assumption as there are large elasses of systems in whieh the effeet of all the unknown inputs 
may not be seen in the output in the immediate next time step but may be seen in subsequent 
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time steps (when CH does not have full eolumn rank). Furthermore, eonvergenee results for the 
filters developed re largely missing the literature. 

Reeent work on input and state observability lUTIl question the need for this assumption and in 
faet eonelude that in the ease that CH h not full eolumn rank but other eonditions are satisfied, 
it may be possible estimate inputs and states with a time shift (with a delay). That is, it may be 
possible to estimate e^-r or xu-r given measurements of yk- However, ffTTlI does not provide a 
robust, reeursive way to estimate these states and inputs. iTTSll . ^2M . [|25]|, ifT^ take advantage of 
this idea to explore reeursive filter-based methods to estimate past (delayed) states and inputs 
based on measurements of eurrent outputs. [|^ represent some initial preliminary efforts in this 
direetion, while [l24l develops a heuristie method for square systems (dimension of inputs are 
same as dimension of outputs). ifT^ ineorporates a reeonstruetion delay with the purpose of 
negating the effeet of non-minimum-phase zeros on the reeonstruetion error. Note that it has 
been established in [fTTI and other related works that non-minimum-phase invariant zeros in the 
system present a fundamental limitation in reeonstruetion of unknown inputs and states. 

[fTSll develops a filter that uses a bank of measurements from eurrent time (fc) to a past time 
(k — r) to estimate the states at time instanee k — r. While this paper is able to sueeessfully relax 
the assumption that CH must have full eolumn rank and drawing eonneetions with presenee of 
invariant zeros in the system, it does not foeus on input reeonstruetion and foeusses on state 
estimation alone. Further, the results are not eonneeted to observability results present int he 
literature. 

In this paper, we develop a novel but relatively simple elass of filters that ineorporates 
a reeonstruetion delay in estimating the states and the unknown inputs of the system. This 
reeonstruetion delay allows us to relax the assumption of CH having full eolumn rank and thus 
are applieable to a larger elass of systems. These filters use measurements up to time step k to 
reeonstruet states and inputs up to time step k — r, where r is a non-negative integer (see Figure 
[T]). This is referred to as reeonstruetion of the inputs with a delay of r time steps and should not 
be eonfused with the system dynamies having a delay. We further show that the reeonstruetion 
delay r is not the ehoiee of the user but rather dependent on the system and ean be eharaeterised 
in terms of the rank of matriees eontaining markov parameters. 
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For these new filters, we then develop necessary and sufficient conditions for convergence 
and investigate their relationship with the multivariable invariant zeros of the system. We further 
establish conditions under which a stable filter exists and relate these conditions to system 
invertibility results. 

Thus we make three important contributions. First, we develop a new class of filters that apply 
to a wide range of systems by incorporating an appropriate delay in input reconstruction, with no 
restrictions on the nature of input. Second, we develop sufficient conditions for convergence of 
the estimates that is largely absent in the literature. By further establishing that several existing 
filters are special cases of the current filter, we are also indirectly proving convergence results 
for several filters int he literature. Third, we establish a connection between invertibility results 
in the literature with conditions for existence and convergence of the proposed filters. Since 
invertibility and observability literature and filtering literature have been mostly disparate thus 
far, this is a contribution that helps connect two sets of results in the literature. 

Output 

‘j 

Reconstructed Input 

k-r-2 k-r-1 k-r+1 l' iS t k+1^ 

Time 

Fig. 1. Concept of input reconstruction with a delay. 


We first start by introducing and developing the new filter in the following section. 

2. Unbiased Filter with General Delay 

Consider state estimation and input reconstruction with a delay of r time steps, that is, 
measurements up to time step k are used to estimate states and inputs at time step k — r. 
Consider a state-space system 


Xk+i = Axk + Buk + Hck + Wk, 


( 2 . 1 ) 


Vk = Cxk + Duk + Vk, 


( 2 . 2 ) 
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Xfc G M”, Mfc G G Cfc G are the state, known input, output measurement, unknown 

input veetors, respeetively, Wk G and Vk G MJ are zero-mean, white proeess and measurement 
noise, respeetively, and A G B G H G C G and D G . Note 

that Cfc is an arbitary unknown input and ean represent either deterministie or stoehastie unknown 
signals. First we eonsider the simplifieations B = 0 and D = 0. Note that the filter derivation 
is independent of B and D matriees, and thus the assumption on B and D matriees is for 
eonvenienee alone. Without loss of generality, we assume I < n also we assume p < n and 
rank(i7) = p. I > n would imply the presenee of redundant sensors. 

For the state-spaee system ( |2.1[ ), ( |2.2| ) (and with B = 0 and D = 0), we eonsider a filter of 
the form 


^k—r\k ^k—r\k—l A Lkijjk CXk\k—l)) (2.3) 

where 

^k—r\k—l -^^k—r—l\k—li ^k\k—l ^ ^k—i —l|fc—!• (2.4) 

The unique feature of the above filter equations is that estimates are eomputed with a delay of r 
time steps. That is, Xk-r\k is the state estimate at time step k—r given output data (measurements) 
up to the eurrent time step k. Note that Xk\k-i is a r + 1 step open loop predietion based on the 
previous state estimate Xk-r-i\k-i 

Next, we define the state estimation error as 

^k—r — ^k—r ^k—rlk: (2.5) 

and the error eovarianee matrix as 

Pk-r\k = E[ek-r£l-r\- (2-6) 


A. Necessary Conditions for Unbiasedness 


Definition 2.1. The filter (2.3) - (2.4) is unbiased if Xk-r\k is an unbiased estimate of the state 


Xk—r- 
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Definition |2. 1 1 implies that the filter (2.3)-(2.4) is unbiased if and only if 


]E[£'fc_^] ]E[xfc_j- 0. 


(2.7) 


Next, we note that 


^k—r ^k—r ^k—r\k 

L]^(^CX}^ H“ V}^ 

l) • 

= (2l - LkCA^+^)ek-r-i + (77 - L^CA^H)ek-r-i 
- LkCA^-^Hck-r - LkCA^-^Hck-r+i + •.•+ 
LjkCAHciz—2 LkCH€-k—l ~\~ Wk—r—1 Lki^CA Wk—r—l~^ 

CA'' ^Wk-r + ••• + CWk-1 + Vk)- 


Theorem 2.1. Let Lk be sueh that the filter (2.3) - (2.4) is unbiased. Then 


H - LkCA^H =LkCA^-^H = LkCA^-^H = 
... = LkCH = 0 


( 2 . 8 ) 


(2.9) 


Proof: Sinee by definition, filter (2.3) - (2.4) is unbiased if and only if E[£fc_r_i] = 0, it 


follows from (2.8) that 


E[£fc_,] =E[(2l - LkCA^^^)ek-r-i + (77 - LkCA^H)ek-r-i 
- LkCA^-^Hck-r - LkCA^-^Hck-r+i + ... 

+ LkCAHek-2 ~ LkCHck-i + Wk-r-i~ 

Lk{CA^Wk-r-l ~\~ CAl^ + ... + C'Wfc-i + Vfc)] (2.10) 


Sinee (2.10) must hold for arbitrary input sequenee e^, it follows that (2.9) must hold for filter 


(2.3) - (2.4) to be unbiased. 


□ 
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Corollary 2.1. Let be such that the filter (2.3) - (2.4) is unbiased. Then, the following 
conditions hold 

i) p<l, 

a) rank{CA^H) = p. 

Hi) rank(Lfc) > p, for all k, 

iv) xank{CA'^H) < I — p, for d = 0,..., r — 1. 


Proof. Since the filter ( |2.3[ )- ( |2.4[ ) is unbiased, it follows from Theorem |2.1| that ( |2.9[ ) holds 
and hence 


Lk{CA''H) = H. 


( 2 . 11 ) 


Since rank(id)=p, it then follows from (2.11) that Hi) holds and 


vank{CA^H) > p 


( 2 . 12 ) 


Since CA^H G it follows from (2.12) that statement i) holds. Furthermore, it follows from 


(2.12) and i) that statement ii) holds. 


Finally to prove iv), since ( |^ ) holds, it follows from [[2^ Proposition 2.5.9, p. 106] that 
Tank{LkCA‘^H) = 0 and therefore 


rank(Lfc) + rank(C'y4'^if) < rank{LkCA'^H) + I 

= 1 . 


(2.13) 


Furthermore, using Hi), (|2.13) becomes 


p + rank(C'A^id) < /, 


(2.14) 


that is, rank{CA‘^H) <l — p. 


□ 


Corollary 2.2. Let I = p and let Lk be such that the filter (2.3) - (2.4) is unbiased, and let 
I = p. Then, CA^H = 0 for d = 0, ..., r — 1 and rank(Lfc) = p for all k and r. 
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Next, we define the Rosenbroek matrix Z{s) as 




{si-A) H 
C 0 


For an unbiased filter, we know from Corollary |2.1[ i) that p < I, therefore the transfer funetion 
G{s) = C{sl — A)~^H has normal rank equal to p. 


Definition 2.2. z e C is an invariant zero [[26ll of (12.Ih, (12.21) if 


rank Z{z) < normal rank Z{s). 


Definition 2.3. The filter (2.3)-(2.4) is asymptotieally unbiased if 


lim = 0 

k^oo 


Definition 2.3 implies that the filter (2.3) - (2.4) is asymptotieally unbiased if and only if 
Xk-r\k converges to an unbiased estimate of the state Xk-r as k approaches infinity. 

In the following subsection we first develop the filter and examine its convergence properties 
for a square system {I = p), and treat the non-square case later. 


B. Square Systems 

1) Sufficient Conditions for Unbiasedness: 


Lemma 2.1. Let I = p and let Lk be such that (2.9) holds. Then 


Lk = H{CA^H)-\ 


(2.15) 


Proof. The proof follows from (2.9) and (ii) of Corollary |2.1| 


□ 


Lemma 2.2. Let I = p and let Lk be such that (2.9) hold. Then all non-zero eigenvalues of 


{A — LkCA^^^) are invariant zeros of (2.1) and (2.2). 
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Proof. Let A ^ 0 be an eigenvalue of {A — L^CA^^^). Then using Lemma 2.1 it follows that 


det(Al - H{CA^H)-^CA^+^ - \I) = 0. 


Next, let z/ 7 ^ 0 be such that 


{A - H{CA^H)-^CA^+^ - XI)u = 0, 


and thus 


{A - XI)u - H{CA^H)-^CA^^^u = 0. 


Next, defining 


/i A -(CA^H)-^CA^+^u, 


(2.16) 


it follows that 


[A — A/)z/ + Hfi = 0, 


(2.17) 


and thus yielding 


Au = Xu — Hjj, 


(2.18) 


and 


A^+^u = XA^u - A^Hfi. 


(2.19) 


Repeatedly using (2.18) in (2.19), we get 


A^+^u = A"+V - X^H^i - X^-^AHfi - ... - XA^-^Hfi - A^Hfi. 


Left multiplying by C on both sides gives 

CA^+^u = X^+^Cu - X'^CHfi - X^-^CAHfi - ... - XCA^-^Hfi - CA^H^i. 
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Since from Corollary 2.2 it follows that CA^H 
invertible, we have 


0 for (i = 0, ..., r — 1 and sinee CA'H is 


{CA^H)-^CA^+A = X^+^{CA^H)-^Cv - /i, 


and thus 


/i = -{CA^H)-^CA^+^v + y+\CA^H)-^Cv. 


Comparing (2.20) with (2.16), it follows that 


W+^{CA^H)-^Cv = 0 . 


( 2 . 20 ) 


Sinee A 7 ^ 0, and {CA^H) ^ is full rank, it follows that 

Ci/ = 0. 


( 2 . 21 ) 


Combining (2.17) and (2.21), we have 


1 

1 

1 

<< 


V 

C 0 


. ^ . 


= 0 . 


( 2 . 22 ) 


Sinee i/ 7 ^ 0, it follows that 


/i 


7 ^ 0 and noting that normal rank Z{s) = n+p from Corollary 


12 . 10.6 in n2m . it follows that 


rank 


1 

1 

1 

<< 

< normal rank 

■ {zl - A) 

-H 

C 0 


C 

0 


= n + p. 


Therefore A is an invariant zero of {A,H,C). 


(2.23) 


□ 


In Lemma (2.2), we established the relationship between the invariant zeros and the eigenvalues 
of {A — LkCA'"^^). Next, we use this relationship to examine the eonvergenee of the filter. 


Theorem 2.2. Let I = p and let be sueh that (2.9) hold. Then the filter (2.3) - (2.4) 


is unbiased if and only if (2.1), (2.2) have no invariant zeros, while the filter (2.3) - (2.4) is 
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asymptotically unbiased if and only if all of the invariant zeros lie within the unit eirele. 


Proof. First, taking the expeeted values of both sides of (2.8) and using (2.9), and noting that 

E,[wk-r-i] = E[r’fc] = = 0, it follows that 


E[ek-r] = E[(^ - LCA^+^)ek-r-i] = {A- LCA^+^)E[ek-r-i]- 


(2.24) 


Therefore, filter (2.3) - (2.4) is unbiased if and only if (A — LCA^^^) is zero or equivalently all 


eigenvalues of {A — LCA^^^) are zero. Furthermore, (2.3) - (2.4) is asymptotieally unbiased if 
and only if {A — LCA^^^) is asymptotieally stable. It follows from Lemma 2.2 that all non-zero 


eigenvalues of {A — LCA^^^) are invariant zeros of (2.1), (2.2). Subsequently, the filter (2.3) 


- (2.4) is asymptotieally unbiased if and only if no invariant zeros of (2.1) and (2.2) are non- 
minimum-phase and there are no zeros on the unit eirele (all of the invariant zeros are within 
the unit eirele). The filter gives rise to a persistent reeonstruetion error if the zeros lie on the 
unit eirele. □ 


C. Input Reconstruction 

We diseussed neeessary and suffieient eonditions to obtain the unbiased estimates of states. 
Next, we eonsider using these estimates to reeonstruet the unknown inputs. 


Proposition 2.1. Let I 

estimate of Xk-r- Then 


p and let Lk be sueh that (2.9) hold, and let Xk-r\k be an unbiased 


Ck-r-i = {CA^H)-\yk 


C'Xk\k—l^ 


(2.25) 


is an unbiased estimate of Ck-r-i- 

Proof. Sinee xznkiCA''H) = p, we ean define 

Ck-r-i = {CA^H)-\yk - Cxk\k-i). (2.26) 
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Next, using (2.26), (2.3), (2.5), (2.15) it follows that 


eu-r-i = {CA^H)-^CA^H{CA^H)-\yk - Cxk\u-i) 

= {CA'-H)-^CA^Lk{yk - 
= {CA^H)-^CA^{x,,_r\k-xu-r\k-i) 

= (CA^H) A^{Xk-r + ^k-r — Xk-r\k-l) 

(^CA CA (^AXk—r—l 3“ HCk—r—l “f '^k—r—1 3“ ^k—r AXk—r—l\k—l) 

= {CA^H) A^i^Aek-r-i A Hek-r-i + Wk-r-1 A Sk-r)- (2.27) 


Finally, taking the expeeted values of both sides and noting that 

E[ek-r] = E[ek-r-i] = E[wk-r-i] = 0, (2.28) 

it follows that 


E[ek-r-i\ = {CA^H)-^CA^HE[ek-r-i\ = E[ek-r-i\- □ 


D. Non-square Systems 

In the previous subseetion we dealt with square systems. In this seetion we explore the 
possibility of input reeonstruction with a delay for non-square systems (/ ^ p). In the eontext of 
non square systems, first we show that the invariant-zeros of the non-square system are a subset 
of the eigenvalues of {A — LkCA^^^) as follows. 


Lemma 2.3. Let Lk be such that (|2.9p is satisfied. Then the invariant zeros of system (|2.ip, 


(2.2) are a subset of the eigenvalues of {A — LkCA^^^). 


Proof. Let z be an invariant zero of (2.1), (2.2), and let veetor 


/i 


7 ^ 0 be sueh that 


1 

1 

1 


V 

C 0 


. ^ . 


(2.29) 
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Therefore 


{zl — A)i> — Hfi = 0, 
Ciy = 0. 


Note that if i/ = 0, it ean be seen from (2.30) that H/j, = 0, but sinee rank(iT) = 


violating the assumption 




7 ^ 0. Henee u ^ 0. 


Next, left multiplying (2.30|) by LkCA^ and rearranging, 


zLkCA^u - LkCA^+^u = LkCA^Hfi. 


Also it follows from (2.30) that. 


Av = zv — H^. 


Next using (2.33) in (2.32) and rearranging. 


z^^^LkCu - z^LkCHfi - z^-^LkCAH^i 

- zLkCA^-^Hfi - LkCA'^+^u = LkCA^Hfi. 


and using (2.31), (2.9), 


-LkCA^+^iz = Hii. 


Using (2.35) in (2.30), 


{zl - A)v + LkCA^+^iz = 0, 


zlu — Au + LkCA^'^^u = 0, 


(2.30) 

(2.31) 

p, /i = 0 


(2.32) 

(2.33) 


(2.34) 

(2.35) 
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and further rearranging, we have 


{A - LkCA^+^ - zl)u = 0. 


(2.36) 


Sinee u ^ 0, It follows that 2 ; is an eigenvalue of {A — LkCA^~^^). 


□ 


For a non-square system, we note however that the eonverse of Lemma 2.3 does not hold as the 


following eounter example demonstrates. 


Consider a state spaee system eharaeterized by the following A, H,C matriees. 



-0.95 

-0.04 


0 


0 

0 

0 

0 

0 

0 

0 

0 

0 


0.4 

0 


0.025 

1 


0 


0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 


0 

0 


0.97 

- 

0.06 

0 

0 

0 

0 

0 

0 

0 

0 


0.2 

0 


0 

0 


0.05 


1 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 


0 

0 


0 


0 

0.95 - 

0.05 0 

0 

0 

0 

0 

0 


0.2 

0 

A = 

0 

0 


0 


0 

0.1 

1 

0 

0 

0 

0 

0 

0 

, H = 

0 

0 


0 

0 


0 


0 

0 

0 

0.98 

-0.04 

0 

0 

0 

0 


0 

0.2 


0 

0 


0 


0 

0 

0 

0.05 

1 

0 

0 

0 

0 


0 

0 


0 

0 


0 


0 

0 

0 

0 

0 

0.95 

-0.08 

0 

0 


0 

0.2 


0 

0 


0 


0 

0 

0 

0 

0 

0.05 

1 

0 

0 


0 

0 


0 

0 


0 


0 

0 

0 

0 

0 

0 

0 

0.95 

-0.06 


0 

0.2 


0 

0 


0 


0 

0 

0 

0 

0 

0 

0 

0.1 

1 


0 

0 


0.25 2 

0 

0 

0 

0 

0.5 

2 

0 

0 

1 

O 

o 








C = 

0 0 

0.5 

2 

0 

0 

0 

0 0.5 

2 

0 0 





(2.37) 




0 0 

0 

0 

0.5 

1 

0 

0 

0 

0 

0.5 1 









It is seen that this system has an invariant zero at 0.8 of multiplieity two. The eigenvalues of {A — 
LkCA^), a delay of one-time step, (r = 1), are found to be 0.7528, 0.9782 -f 0.0707i, 0.9782 — 
0.0707i, 0.9750 -f 0.0443i, 0.9750 — 0.0443i, 1.0076, 0.8, 0.8. It ean be seen that the invariant 
zeros of the non-square system are the eigenvalues of {A — L^CA^) in aeeordanee with lemma 


2.3 but along with other spurious eigenvalue of whieh are not the invariant zeros of the system. 


This result is obtained using a value of Lk that satisfies (2.9). The ealeulation of Lk in the 


example (2.37) is based on the proeedure whieh is diseussed next. 


We note that in the non-square ease, an infinite number of solutions for Lk that satisfy (2.9) 
are possible. The following results thus derive the Lk that minimizes the traee of the error 
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covariance and hence the minimum varianee gain. and Rk are the proeess noise eovarianee 
and sensor noise eovarianee respeetively. 


Fact 2.1. Let Lk be sueh that the filter (2.3) - (2.4) is unbiased. Then 


Pk-r\k = {A- - L,CA^+y 

+ (/ - LkCA^)Qk-r-i{I - LkCA^f + {LkCA^-^)Q,_r{LkCA^-y + 
... + {Li,C)Qk-i{Li,Cf + LuRkLl 


Proof. The proof follows by substituting (|2.8|) in (2.6) and using (2.9). 


(2.38) 

□ 


Next, define the eost funetion J as the traee of the error eovarianee matrix 


J(^Lk) tr]E[£^_j.£^_j,] tTPk—r\k- 


(2.39) 


Therefore, it follows from (2.38) that 


J{Lk) = tr[(A - LkCA'^+^)Pk-r-i\k-i{A - L^CA^+^f 

+ (J - LkCA^)Qk-r-i{I - LkCA^f + {LkCA^-^)Qk-r{LkCA^-y + 

... + {LkC)Qk-i{LkCf + LkPkLj ]. (2.40) 

To derive the unbiased minimum-varianee filter gain, we minimize the objeetive funetion (|2.40|) 


subjeet to the eonstraints (2.9) while noting that from Corollary 2.1 we have r:ank{CA‘^H) < 

I — p. 


Theorem 2.3. Suppose there exists at least one that satisfies (2.9), then the unbiased 
minimum-varianee gain Lk is 


L k 


TkA^'^C^ + NkZl[CA^H CA^-^H ... CH] 


Sk^- 


(2.41) 
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where 


Tk Qk—r—l “1“ -^Pk—r—llk—l-^ j 

Sk = CA^TkA^^C^ + CA^-^Qk-rA^-^^C^ + ... + CQk-iC^ + Rk, 


{CA^H)^S^\CA^H) {CA'^HfS^\CA'^-^H) ... {C A^ H)^ S^\C H) 

{CA^-^HfSj^\CA'^H) {CA^-^HfS^\CA^-^H) ... {C A'^-^ Hf S^\C H) 


{CHfS^\CA^H) {CHfS^\CA'^-^H) ... {CHfS^\CH) 


and 


Nk 


H -TkA^'^C^S^^CA^H -TkA^^C^S^^CA^-^H ... -TkA^'^C^S^^CH 


Proof. The Lagrangian for the eonstrained minimization problem is 


£(Lfc) ^ J(Lfc) 

+ 2tT{[{I-L,CAnH LkCA^-^H ... LkCH]Ak), 


(2.42) 


where G is the matrix of Lagrange multipliers. Next, differentiating (2.42) with 

respeet to and setting it equal to zero yields 


-2CA^Qk-r-i - 2CA^+^Pk-r-i\k-iA^ + 2[CA^+^P,_r-,ik-iA^^^" 

+CA^Qk-r-iA'^'"c^ + CA^-^Qk-rA^-^^C^ + ... + CQk-iC^ + Rk]Lj 
-2[CA'^H CA^-^H ... CH]Ak = 0. (2.43) 


Next assuming Sk is invertible and solving (2.43) for Lk, we get 


Lk — 


TkA^'^C^ + Al[CA'^H CA^-^H ... CH] 


Sk^- 


(2.44) 
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Next, to solve for A^, we substitute (2.44) in (2.9) to get 


+ Kl[CA^H CA^-^H ... ChY S^^[CA^H CA^-^H ... CH] = 


[H 0 


nxp 


Onxp] ■ 


Next we define Zk and Nk as follows 


{CA^HfS^\CA^H) 

{CA^-^HfS^\CA^H) 

{CHfS^\CA^H) 


{CA'^HfS^\CA'^-^H) 

{CA^-^H)^S^\CA^-^H) 

{CHfSl\CA^-^H) 


(2.45) 

{CA^HfS^\CH) 

{CA^-^HfSj:\CH) 

? 

{CH)'^S^\CH) 

(2.46) 


Nk 


H - TkA^'^C^S^^CA^H -TkA^^C^S^^CA^-^H 


-TkA^'^C^S^^CH 


(2.47) 


Therefore (2.45) beeomes 


A^Zk = Nk. 


(2.48) 


Solving for we get 


= NkZl 


(2.49) 


Where Zl is a Moore-Penrose generalized inverse of Zp. Substituting (2.49) in (2.44) we get 




TkA^'^C^ + NkZl[CA''H CA^-^H ... CH] 


Sk"- 


□ 


Note that the assumption of Sk being invertible is ensured by demanding apriori that Rk is positive 
definite for all k. This indieates the persistenee of sensor noise and is a valid assumption on 
physieal grounds. Qk is assumed to be nonnegative definite for all k. It should also be noted 
that sinee Zk is not full rank there are an infinitely many possible solutions for A^. However at 
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any instant k, any that satisfies (2.49) will give the same minimum-varianee gain (L^). 


Corollary 2.3. Suppose CA^H = 0 for c? = 0, 1, ..., r then the unbiased minimum-varianee 
gain Lk is 


Lk. 


TuA^ SY, 


r u\T 


(2.50) 


where 


Tk Qk—r—l : 

Sk = CA^TkA^'^C^ + CA^-^Qk-rA^-^'"c^ + ... + CQk-iC^ + Rk, 


= 


H-T.A^ C^SYCA^H 


{{ca^hYsYca'-r) ^ 


(2.51) 

(2.52) 

(2.53) 


In the next seetion we present some numerieal results using the previously developed filter. 


3. Existence AND MAXIMUM DELAY 


Aeeording to (2.9), Lk should satisfy the eondition 


Lemma 3.1. Li 


CA^H CA^-^H 


CA'-R CA^-^R...CR 


CR 


R 0 




i/ 0 ... 0 


\l r > n 


Proof. Suppose on the eontrary, assume 


CA^R CA^-^R...CR 


n. Let r = n. The eondition for unbiasedness beeomes 


(3.1) 


if 0 ... 0 


V r > 


CA^R CA^-^R...CR 


R 0 ... 0 


Using Cayley-Hamilton theorem and after rearranging (|3.2|) beeomes 


{diLkCA^-^R + d2LkCA^-^R + ... + dnLkCR) LkCA^-^R... LkCR 


(3.2) 


if 0 ... 0 
(3.3) 
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which results in a contradiction, which is also true for all r > n. Hence our assumption is wrong 
and therefore 


CA'^H CA^-^H...CH 




H 0 


'i r > n 


□ 


This shows that the choice of the delay, r, cannot be arbitrary and has to be smaller than the 
system order. The lower bound on the delay is determined by the first Markov parameter which 
has full rank. 


Conjecture 3.1. The filter will be unbiased for only one value of the delay r, i.e. there exists 
only one value of r that satisfies condition ( |3.1| ). 

Next, we introduce the following notations 


A 

*^7’ - 


A 

*^r—1 


CA^H CA^-^H ... CH 
CA^-^H CA^-^H ... CH 


Theorem 3.1. There exists a matrix that satisfies (3.1) if and only if 


rank 


5 , 


— rank 




= P 


Proof. There exists a matrix Lk that satisfies (3.11 if and only if the matrix 


H 0 


is in the space spanned by the rows of Sr- This is equivalent to the condition 


rank 




H 0 


= rank 


Sr 


(3.4) 


(3.5) 


rank 


CA^H 

CA^-^H . 

. CH 

H 

0 

. 0 
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Using the matrix identity 


rank 


A B 


= rank 


A 


+ rank 


B 


dimf 


A 


nJi 


B 


and noting that rank [if] = p we get 


rank 




if 0 ... 0 


= rank 




+ p. 


From (3.5) and (3.7) we get the condition 

rank 




= rank 




+ p. 


Corollary 3.1. If rank 


5, 


rank 




= p then rank 




rank 


Mr-l 


Mr = 


CH 

0 

0 

.. 0 

CAM 

CH 

0 

.. 0 

CA^H 

CA^-^H CA^-^H ., 

.. 0 


Proof. Using ( |3.6| ) we have 


rank 






CH 


CH 


Mr 

— rank 

Mr-1 

= rank 

CAH 

+ dim ^5^ 

CAH 

n 3^ 





CA^H 


CA^H 



Ai,—1 


(3.6) 

(3.7) 

□ 

= p, where 


), (3.8) 
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where ean also be represented as follows 


Mr-1 


0 0 
CH 0 
CAH CH 


. 0 

. 0 

. 0 


Sinee, rank 




— rank 


5.-1 


5.-1 


= p aeeording the Theorem 


(3.9) 


3.1 


there exists a matrix Lu sueh 


that (3.1) and henee (2.9) is satisfied. Then from Corollary 2.1, ii) we have iai\k{CH) = p. 
Therefore 


rank 


CH 

CAH 

CA^H 


= p. 


Next, Using (3.6) we have 


rank 


5. 


— rank 


5.-1 


= rank 


CA^H 


+ dim ^3? 


CA^H 




5.-1 


Now sinee, rank 


5. 


— rank 


5.-1 


= p and rankleA^H) = p, (3.11) leads to 


dim( 3? 


CA^H 


n3? 


5.-1 


= 0 . 


From (3.8), (3.9) and (3.12) we have 


dim 


CH 

CAH 

CA^H 


n3i 


M.-i 


= 0 . 


(3.10) 


(3.11) 


(3.12) 


(3.13) 
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Next, substituting (3.10) and (3.13) in (3.8) leads to 


rank 




rank 


Mr-l 


= p. 


□ 


This in turn implies that the system ( 2.1| ) and (2.2) is r-delay invertible [|23. However it 
should be noted that the r-delay invertibility of a system is not a suffieient eondition for the 


existenee of Lk whieh satisfies the eondition (3.1) as the following example shows. Consider 
the system 



0.5 

-0.6 

0 

0 


4 

0 


0.5 

0 

0 

0 


0 

0 

A = 

0 

0 

-0.5 

-0.6 


0 

4 


0 

0 

0.5 

0 


0 

0 


,C' = 


0.25 

1.05 

0.25 

1.1 


0.25 

1.15 

0.25 

1 


0.25 

1.05 

0.25 

1.1 



— rank(S'r- 

i) < P- 


4. Numerical Results Using an Unbiased Filter with Delay of One Time Step 
A. Numerical Results - Square Systems 



Fig. 2. This compartmental model comprises of six compartments that exchange mass or energy through mutual interaction. 
The inputs are provided to the first and the last compartment while the states from the second and the fifth compartment are 
measured and constitute the outputs. 


To illustrate recursive input reconstruction, we consider a compartmental system comprised 
of n compartments that exchange mass or energy through mutual interaction. This can repre- 
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sent physical models like collection of rooms which mutually exchange mass and energy. The 
conservation equations governing the compartmental model are 

xi^k+i = xi^k - + a{x2,k - xi^k), (4.1) 

^i,k P^i,k T ^ijk') ^{p^i,k ^i—l,k)i 

2 = 2, ..., n - 1, (4.2) 

^n,k+l ^n,k (^^n,k (^{,^n,k ^n—l,k^i (4.3) 

where 0 < /3 < 1 is the loss coefficient and 0 < a < 1 is the flow coefficient. Figure illustrates 

a schematic of the compartmental model wherein each block represents a compartment. The 

arrows labeled ei, 62 indicate the input to the system while the arrows labeled yi, y 2 indicate 


the output. The system equations (4.1) - (4.3) can be written in the state space form (2.1), (2.2) 
with 


A = 


1 — — a a 0 

a 1 — /3 — a a 


0 


0 

0 


(4.4) 


0 a 1 — (3 — a 

Further, for the numerical simulations, we choose n = 6 , a = 0.1 and (3 = 0.1, we assume 
we have no known inputs and therefore the Buk and Duk terms disappear, and we assume 
two unknown inputs enter compartments 1 and 6 , while the states in compartments 2 and 5 are 
measured as outputs. It then follows that 


(4.5) 


Note that since CH = 0, the filters in dH, fl^ . [fTTll . [1221 cannot be applied for input re¬ 
construction (or state estimation). Further, since CAH is full rank and there are no invariant 









T 









1 

0 

0 

0 

0 

0 



0 

1 

0 

0 

0 

0 

H = 

0 

0 

0 

0 

0 

1 

5 

c = 

0 

0 

0 

0 

1 

0 


zeros of the system, it follows from Theorem |2.2| that the filter ( |2.3[ ) - ( |2.4[ ), ( |2.15[ ), ( |2.25| ) 
with r = 1 will provide an unbiased estimate of the unknown inputs. We choose the first input 
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to be a sawtooth and the second input to be a sinusoid. Figure shows the actual unknown 
inputs and the estimated unknown inputs using the recursive filter developed previously. The 



Fig. 3. Actual and estimated inputs for the compartmental model example. The filter uses a delay of one time step (r=l), since 
CFf = 0 and CAH is full rank. 



Fig. 4. The inputs are provided to the first and the last compartment while the states from the third and the fourth compartment 
are measured and constitute the outputs. 


compartmental model is a convenient example to illustrate delayed input reconstruction since 
by changing the compartments from which the states are measured, the product CA^H can be 
altered. For instance, if the inputs are given to the compartments 1 and 6 and the states in the 
compartments 3 and 4 are measured as outputs then it follows that 


(4.6) 


Note that in this case CH = 0, CAH = 0 and CA^H is full rank. This implies that input 








T 






-l 


1 0 

0 

0 

0 

0 


0 

0 

1 

0 

0 

0 

H = 

0 0 

0 

0 

0 

1 


0 

0 

0 

1 

0 

0 


reconstruction is only possible using the filter (2.3) - (2.4), (2.15), (2.25) with a minimum delay 
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of two time-steps i.e. r = 2. In this ease, results similar to those in Figure are obtained, but 
not shown here due to spaee constraints. Note that the filters in [|9l, [f2ll . ^T2\ are no-delay filters 
and require CH to be full rank and hence cannot handle the case where CH = 0. 

Next we present a numerical result illustrating delayed input reconstruction in presence of 
minimum phase zeros. Consider a state space system characterized by the following A, H,C 
matrices. 



1.1 

-0.6 

1 


2 

A = 

0.5 

0 

1 

, = 

0 


0 

0.2 

0.3 


0 


C 


0 0.4 1 


This system has a zero at —0.2 (minimum phase) and the eigenvalues of {A — LkCA^) are 
0, 0, —0.2 in accordance to Lemma 2.2 Figure shows the actual unknown input and the 
estimated unknown input using the recursive delayed input reconstruction filter. Figure shows 



Fig. 5. Actual and estimated inputs for a system with minimum phase zero 


the error in state estimation. The computed state estimation error represents the error computed 


using (2.24) and substituting r = 1 and assuming that the initial condition of the states is known. 
The computation was done using the eigenvalues of {A — L^CA^) and the results were plotted 
against the actual state estimation error. The exact overlap between the actual and the computed 
state estimation error consolidates the finding that the invariant zeros of the system govern the 
dynamics of the state estimation error while the decaying nature of the error is in accordance 
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with the Theorem 12.21 with r = 1. 


■ Actual state estimation error ■ Computed state estimation eiror] 



Time Time Time 


Fig. 6. Error in state estimation for a system with minimum phase zero 


Now eonsider a state spaee system eharaeterized by the following A, H,C matriees. 



0.0725 

1 

0.2072 


0 

A = 

-0.6158 

0.0725 

0.2339 

, H = 

0 


0 

0 

-0.1449 


4 

C = 

5.005 0 

0 ■ 





This system has a zero at —1.0564 (nonminimum phase) and the eigenvalues of A — LkCA^ are 
—1.0564, 0, 0 in aeeordanee with |2.2[ Figure shows the aetual unknown input and the estimated 
unknown input using the reeursive delayed input reeonstruetion filter. Figure shows the aetual 



Fig. 7. Actual and estimated inputs for a system with nonminimum phase zero 


and eomputed error in state estimation. 
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Fig. 8. Error in state estimation for a system with nonminimum phase zero 


B. Numerical Results - Non-square Systems 


State estimation and input reeonstruetion with a delay of one time step is performed for the 
non-square state spaee system eharaeterized by the following A, H, C matrices. 



0.0725 

1 

0.2072 


0 

A = 

-0.6158 

0.0725 

0.2339 

, = 

0 


0 

0 

-0.1449 


4 


C = 


5.005 0 0 

0 0.1 0 


. The minimum variance gain for the estimator is computed using Corollary |2.3[ Figure |9] shows 
the actual unknown input and the estimated unknown input using the recursive delayed input 
reconstruction filter. It should be noted that the convergence of the filter in this case is asymptotic. 



Fig. 9. Input reconstruction for a non-square system 
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In the next seetion we highlight the relationship between the filter developed in this paper and 
the filters developed in dH, ll^ . [l22l . 


5. Relationship with Unbiased Minimum Variance Filters With No Delay 


In this subseetion, within the eontext of square systems (/ = p), we show that the filters 
developed in dH, d2T1l . d22l are speeial eases of the filter (|2.3|) - (|2.4|), (|2.15|), (|2.25[) with r = 0. 


Proposition 5.1. Let I = p, then the unbiased minimum varianee filters in d^ (3) - (6) along 
with (13) and (20)] and [0 are equivalent to the filter ( |2.3| ) - ( |2.4[ ), ( |2.15| ), ( |2.25| ) with r = 0. 


Proof. The proof follows by first noting that in the ease I = p, CH (F^ in dZIl) is invertible, 
and then following straight-forward substitution and simplifieation. □ 

Note that d2T]l . d9ll do not prove eonvergenee of the respeetive filters, therefore the above result 


proves eonvergenee of the filter through Theorem 2.2 with r = 0 by eonneeting the eonvergenee 


with zeros. Furthermore, note that in the ease / = p with r = 0, from Theorem |2.1[ the filter 
gain must satisfy the eondition 


LCH = H, 


(5.1) 


and sinee rank H = p and eonsequently rank CH = p, L = H{CH) ^ is the only possible L 


that satisfies (5.1) and henee there is a unique solution and no eoneept of a minimum varianee 
solution exists. 


6. Remarks 


While the results in this paper indieate that if the system has nonminimum phase zeros or 
zeros on the unit-eirele, the filter is not eonvergent, it is worthwhile to note however that there 
may be other approaehes that may work in sueh oases as is being explored in d24ll . [12^ . We 
also note here that for square systems having no/minimum phase zeros is a suffioient eondition 
for unbiasedness/asymptotio unbiasedness. In non-square this is not the ease as the example in 
seetion |2-D| illustrates. Note that no-delay filters in dSl, lED, [l22ll would only be applieable 


if CH is full rank. So in the eontext of the numerioal example of a oompartmental model in 
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section 4-A, they would be applicable only if the the output measurements were the states of 
the compartments that the unknown inputs were entering (in this case compartments 1 and 6). 
Finally, in the presence of additional known inputs Uk, note that the same filter equations and 
theory apply with the modified equations 


^k—r\k ^k—r\k—l “f L/k(jJk C/Xk\k—1 DUk), (6.1) 

^k—r\k—l -^^k—r—l\k—l B'^k—r—1} (6.2) 

^k\k—l ^k—r—l\k—l ^"^k—r—l ^^k—r “f ' ' ' 

+ Buk-i (6.3) 

Cfc-r-i = {CH)~^{yk - Cxk\k -1 - Duk). (6.4) 


instead of (2.3) - (2.4). It is to be noted that one drawback of the input reconstruction method 
is that it cannot differentiate between unknown noise and unknown input. 


7. Conclusions 

In this paper, we developed a technique that recursively use current measurements to estimate 
past states and reconstruct past inputs. Furthermore, we derived convergence results for the filters 
developed and established its relationship with invariant zeros of the system. Thus we developed 
a broader class of filters (than traditional unbiased minimum-variance filters), provided necessary 
and sufficient conditions for the filter to provide unbiased estimates, we also established that the 
unbiased-minimum variance filters in [|9l, ll^ . [|22l|, Il23l are special cases of the filter developed 
in this note and provided numerical examples illustrating the key difference between the proposed 
filter and existing methods. The key results are listed below 

1) Necessary conditions for unbiasedness of the filter. 

2) Sufficient conditions for convergence of the filter for square systems. 

3) Showing that the sufficient conditions for convergence of the filter for square systems do 
not hold for non-square systems. 

4) Establishing an upper bound for the filter delay and deriving existence conditions for the 
filter. 

Future work will focus on an in depth analysis of convergence in non-square systems and its 
relationship with the invariant parameters of the system. 
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